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ABSTRACT 

This is a review of the literature surrounding the 
development of techniques for* and changes ih professional attitudes 
toward* the evaluation of community college faculty in their 
instructional role. Discussion focuses on the purpose* criteria* and 
process of evaluation. In discussing the purposes of evaluation* the 
author deals with teacher rating systems* philosophical conflicts 
between evaluation purposes and methods* and educational services* 
accountability and quality. The evaluation criteria discussion 
pinpoints attributes* abilities* and competencies that contribute to 
good teaching. Several lists of criteria are given as possible 
guidelines. The evaluation process is considered in the light of who 
Is to do it and by what means. Several series of outlined procedures 
are given for instituting an evaluation process. (AL) 
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EWiLUATIGH; WHO HEEDS IT? 



Although the evaluation of instruction has a long history in 
American educafe on, few people like to do the evaluating, and even fewer 
enjoy having their teaching effectiveness thus appraised by their fellow 

r^an , 

In exploring the topic, we are dealing with an area of importance 
that has no one answer and perhaps no satisfactory answer for all people 
and for every institution- Somebody else’s approach may not work well 
for anybody else, and a serious mistake would fee made in taking someone 
else's "canned" method and applying it to this or any other community 
college* The best answer is for each college to consider the plans of 
others but to evolve its own rationale and procedures in the light of its 
own unique purposes, personnel, and programs • 

The charge given to me was to join with you in looking at the pur- 
poses and procedures of evaluation for the improvement of instruction: 

Who should be involved In it, what are the pitfalls to avoid, what are 
the advantages and the disadvantages of evaluation? In short, a very 
large order* But let us begin by reviewing orief ly some of the history 
of the subject* 



Much research has been done in the past fifty years or so (most of 
it in the last twenty) to try to determine what makes a good teacher and 
how to evaluate teacher effectiveness. But little agreement has been 

reached except perhaps as to the characteristics of "good 11 teachers 

/ - - - • — 

Presentation at faculty workshop. Mineral Area (CoEmunity) College, 

Flat River, Missouri, on September 3, 1970, by Donald J. Tolls, 

Associate Professor of Higher Education, Southern Illinois University 
at Carbondale ( Note s This presentation was designed to stimulate 
discussion on the part of the faculty.) 
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versus those of "bad" teachers--.™*, ever. thrre, there has been consider- 
a"t ! ig disagreement as to what should be evaluated. Should teacher charac- 
teristics be appraised? Should teacher performance be evaluated? Should 
student learning be measured as a criterion of teacher effectiveness! 
Should some combination of these approaches be attempted? For what pur- 
poses should instructional evaluation be carried out: For improvement of 
instruction? For merit pay purposes? For advancement in rank and/or 
salary? Fot retention on the faculty? For self-improvement of faculty? 

For tenure or continuing contract purposes? 

In one way or another teacher evaluation has been going on as long 
as we have had schools. Early supervision of instruction grew out of the 
responsibility of school boards to provide quality education; and such 
supervision was delegated to school administrators. The general tendency 
was for supervision to be authoritarian in nature and for teachers to be 
"inspected" rather than supervised in the best sense of tnat term. Too 
generally, the belief was that there was only one right way to teach- - 
recitation, drill, memorization, etc. Creativity flu' differentiation of 
approach were exceptions rather than the rule. And only in the past half- 
century or so has there been a. fairly general acceptance of the fact that 
not all good teaching is accomplished by the same means ^ 

Cohen and Braver in their ERIC monograph for the AAJC, entitled 
M easuring Faculty Performance, list 128 representative studies that have 
been carried out from 1915 to 1969, in regard to various facets of the 
topic, A background study of the evaluation of community college instruc- 
tion, carried out by Highland Community College (Freeport, Illinois) this 
year, drew from thirty studies reported between 1928, and 1969, as well 
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as from Its own survey of Illinoic junior colleges- The following 
remarks will refer to findings reported in several of these studies, and 
it will be easy to note that the results are frequently disparate, nebu- 
lous, contradictory, and confusing- -but possibly helpful. Generally 
speaking, the research and/or writing has dealt with three aspects of 

evaluation: Purposes or reasons for having it, standards or criteria, 

! 

and procedures or processes or methods of evaluation. 

i 

Purposes 

In 1950 the ASCD expressed its concern over the fact that teach .r 
rating systems too often fail to allow for individuality and therefore 
may tend to exphasize conformity, 1 The ACE in 1951 stated that "A sem- 
blance of an all-inclusive mechanistic concept tending toward standard- 



ization of approved practices, regimentation of teachers, and the suppress 

ion of originality can do great harm# 11 However, the ACE also said that 

"most teachers can gain from the reasoned judgements of others concerning 

observable aspects of their work" and that for most teachers "evaluation 

should be a means of improving their effectiveness, thus lending to better 

n 2 

security as well as personal satisfaction. 

The NEA, in 1965,. took the position that using '’subjective methods 

of evaluating professional performance" to determine salaries has a 

"deleterious effect on the educational process." But the NEA accepts 

tha fact that the teaching profession has as a major responsibility the 

3 

evaluation of the quality of its services. The fact of evaluation ap- 
pears not to bother teachers as much as the question of how the results 
are to be used. If the purpose is simply the improvement of instruction, 

References cited are listed on page 15. , 
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perhaos mo s t teachers % s ?ouid agree to its value* However , when ^alary or 
merit pay or tenure or rank is involved, an attitude of distrust and 
insecurity frequently may exist . CoUen and Br^uer report that tae accept- 
ance or rejection of the methods of evaluation o f t & n rebates to the d© 

4 

gree of acceptance or rejection of the pu rpo ses of evaluation* Paul 
Dressel (1964) said, "Properly conceived, evaluation is not separate 
from instruction and learning; it is an integral part of both. M Ac- 
cording to Barr, at ol (1961), some form of evaluation is always in pro- 
cess, "whether made openly and carefully or made subversively and hap- 
hazardly. Perhaps most would accept the fact that, if the primary 
purpose of evaluation is the improvement of instruction, it is a neces- 
sary and acceptable contribution to the good of the institution and of 
the profession. It is obvious, however, that, in some way or another, 
decisions must be made regarding placement on the salary schedule, re- 
tention and tenure , and merit pay and rank (wuen^ applicable) * But it 
is generally at the point that evaluation is used for purposes .other than 
improvement of instruction that the main problems arise, . That fact, how- 
ever, should leave this faculty in good condition, since your purpose is 
the use of evaluation for the improvement of instruction. The problem is 
that needed improvement of an individual * s instruction frequently (and 
-roperly) may relate to any one or all of the other purposes just named-- 
and administrators can 1 1 escape the responsibility of dec is ion-making in 
these matters even though there may be a sharing and/or delegation of the 
authority evolved. 

One necessary '"purpose - of "evaluation may well come increasingly into 
the picture during the next several years, and that is the concept of 
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accountability for educational services and 



the quality of tlieii. outcomes. 



Taxpayers and legislators are becoming restive over the high cost of educa 



tion at all levels, the unrest and disruptions taltihg place on campuses 
all over the cour try, and the strong criticisms of lack of relevance be- 
ing directed against a great many educational programs and teaching method 
Although the junior colleges have thus far been only lightly involved in 
such attacks, there is no room for smugness or complacency in any educa- 



tional institution in the country. 

The Council of North Central Junior Colleges which meets in Detroit 

next month has taken as its theme: "Accountability: Rights, Responsibili- 



ties, and Relevance — the 3 R's for the 70's." You may be interested 
In some of the topics that will be discussed at the conference: 
''Accountability for What?" 

"Collective Bargaining and Accountability." 

•'Faculty Accountability in the Community Colleges." 

"The Dean of Instruction and Accountability for Instructional 

Outcomes . " , , 

"Student Rights, Responsibilities, and Accountability in the 

Face of Disruptions." „ 

"Institutional Accountability in Relation to Minority Groups. 
"Presidential Accountability in the Face of Increasing ^Pressures 
from Board, Faculty, Student, and Taxpayer Groups. 



Criteria for Evaluation 

Many studies have attempted to pinpoint those, charaqteristics , 
attributes, abilities, and competencies that contribute to good teaching 
Although there is no consensus, perhaps three general categories of cri- 
teria should be considered in instructional evaluation (as given by 
Bannister, 1961): 

1. Classroom’ atmosphere - a "climate" conducive to student 
ease, where students feel they have the respect of their 
instructor and classmates, where they are challenged - 
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by their work, where they are confident they can succeed* 
and where they experience gratifying success, 

p # Instructor - a person who is tolerant * reasonable* approach^ 
able* who possesses mastery of field and understanding inter 
est and enthu ! asm for the subject* who is tnorougaly pre- 
pared for each class* and who conducts each class efficiently 
without annoyances or mannerisms which divert attention. 

3. Course - one which has clearly defined objectives and stand- 
ards which must be attained, which utilises methods and 
material adapted to specific needs of the student but allo\;s 
for individual differences, in which there is student partic- 
ipation* reviews at regular intervals, fair tests returned 
promptly* in which the interrelatedness of knowledge and 
relation to daily life are stressed, and in which students ^ 
are appraised periodically of the quality of Caeir progress. 

In 1961, Barr gave a comprehensive summary of a large number of studies 

and concluded that* 

1, Judgements as to whether a teacher is effective depend 
upon the criteria used, . 

2, Developing evaluative criteria is a difficult and complex 
undertaking. 

3, There is much unevenness In the abilities of teachers-- 
they may be low in some, high in others* 

4, Teacher acts have an appropriate aspect not good or 

bad in general but in relation to purposes, person^* 
and situations, v , 

5, There may be enough individuality in raters to produce 
differences in the ways in which teachers succeed and fail, 

6, Since teaching does not take place in a vacuum, other 

factors bgside the teacher may influence teaching and 
learning, u ' . 

With all the research that has been done* every study still seems 
to end with a recommendation that even more worU be carried out to iden 
tify the criteria that should be used in the evaluation of instructional 

effectiveness . 

Fritsehel (1967), in trying to describe minimum standards of com- 
petence, noted that such definition can not be on the basis of what a 

ERIC . '6 
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teacher io but by what he does, what action ha performs, what role :ie 

plays, and hot; he carries out his responsibility, lie defined these areas 

of minimum competence as ref lectins a person who (a) is a -director of 

learning, knowing about his learner and how he learns, knowing his subject 

matter, and being a member of a teaching team, (b) has human relations , 

9 

skills, and (c) is an agent of change. 

A great many evaluative instruments have been devised to assess the 
quality of instruction. According to Kent (1967), the most ’common areas 
covered have been course goals, content, materials, assignments, instruc- 
tor behavior, mastery of subject, personal traits, and relationships with 
students. 10 Kent also gave attention to the ''unauthorized" student ratings 
which increasingly are being published on collage campuses with the avowed 
purpose of improving teaching and of aiding students in their selection 
of instructors. Such ratings contain comments about individual teaclier^s 
effectiveness, and in most cases they include information about the instruc- 
tor's enthusiasm for his subject, his organization, his manner of presenta- 
tion, his fairness in grading, and his personal traits (with "warmth and 

friendliness" being particularly valued) . 

An extensive study carried out at the University of Toledo attempted 
to identify those behaviors which reflect positive teaching and to deter- 
mine their relative importance. Over 13, COO such "behaviors" were reported' 

by students, alumni, and faculty/ and then grouped into sixty criterion 

? * , 

abatements , which are, rated; as to their relative importance to good insttruc- 

ii 

tton. . • 

Highland Community College (Illinois) tested the Toledo listing with 

its faculty, students, and administrators and found that a high correlation 
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existed between the ratings of the teaching behaviors by the Toledo and 
the Highland academic communities. , 11, -a first 15 -criteria in .rank order 
(according to the Highland survey) included every. item that appears com- 
monly in many other evaluative instruments, indicating that it is quite 
possible for a college to develop a list of criteria which can identify ■ 
strengths and weaknesses in the instructional process. T..e first fifteen 



items in rank order were ; 

I. Being well prepared for class 
2* Treating students with respect 

3, Acknowledging all questions to the best of- his ability 

4, Using teaching methods which enable students to achieve 
objectives of the course 

5, Being fair and reasonable to studen t 3 _in_ avalua tion procedures 

6, Demonstrating comprehensive knowledge of nis subject 

■7, Establishing sincere interest in the subject being taught 

8. Being readily available for consultation with students 

9. Constructing tests which search for understanding on the 
part of the students rather than rote, memory ability • 

10. Encouraging intelligent independent thought *by students 

II. Patiently assisting, students with tfifiir problems 

12. Communicating effectively at levels appropriate to the 

preparedness of students * 

13, Motivating students to do their- best 

14, Organizing the course in logical fashion 

15. Accepting justified constructive criticism by qualified 
persons 1 

w 

But can the assessment of instructional effectiveness be limited to 
such characteristics as .these? Cphen and Drawer (in Measuring Facult y 



P erform ance) say, "Ho." They' say that teaching can be defined realistic- 
ally only as "causing learning," and they avow that student gain toward, 
specific learning objectives is the only really meaningful criterion that 
can be used in appraising the effectiveness of teachers. ^ They maintain 
■ that such learning can be measured in objective fashion. Pa Ely from this 
school of thought has come the great emphasis in recent years upon the so- 
called "behavioral" or "performance" or "measurable" objectives in education 
Certainly a renewed focus upon objectives , especially in measurable 
■ terms, has merit for each teacher in the planning and conduct of his courses 
Such an approach requires the teacher to think clearly about purposes, con- 
tent, means, ( and outcomes; and to plan carefully is a continuing need for 

all of us who teach. 

But, in °my view, the question is whether we have to "swallow whole" 
this one approach in either our teaching of our evaluation of teaching 
effectiveness. It is quite possible that the intangibles of the teaching- 
learning outcomes are highly important, yet not susceptible to objective 
measurement. Each institution will simply have to decide for itself what 
criteria are to be used fo# the evaluation of instruction, but ..I suggest 

that a multi-directional approach may bear best fruit. 

The Process of Evaluati on . • - » - • 

After decision has been mad,e as to the; purposes for which evaluation 

is to be carried out and as to the criteria which are to be used, the dif- 
ficult retnaining task is development ‘of the process by which evaluation 
y - is tp take place. 1 Who is to do it and by what means? ... 

In I960, AACTE reported the results of a survey jit had taken to find 
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out how colleges sought out the Information used in appraising teacner 

£} 

ability for promotion and pay purpose. Over three- firths reported that 
such information was received by "grapevine," with administrative obser- 
vations, student achievement, and student rating being less used sources 

of 'data.^f 1, ’■ ' 

An ACE survey in 1966 revealed that college undergraduate instruction 

is evaluated in an equal munber of instances (80%) by the department cnair- 
man and by the dean. Colleague evaluation, publication, and informal stu- 
dent opinion each ranked at about the 40th percentile. In the case of 
junior colleges, the dean. evaluated in 82% of those reporting, with depart- 
ment chairmen participating .in 65% and colleague evaluation taking place in 
less than 30% of the total. Publication was an insignificant factor m 
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junior college evaluation, but cldss visitation was used by 42% (compared 
to only 12% in all colleges, both junior and senior, participating in the ^ 

survey) - ' - ; 

;intthe Highland Community College^ survey of Illinois junior colleges, 

of the 24 which responded, five had not yet developed a system of evalua- 
tion, seventeen- use some form of evaluation by administrators,, and six use 
evaluation by colleagues, eight by students, and six by self-appraisal.' 

Ten of the 19 which have an evaluation system allow or require class vis- 
itation by administrators, usually the adacemic dean or department chair- . 

i6 : '• ' ' . ■ 

"■ - <. \ : 

The reasons for which evaluation is carried out frequently result in 
varying type's of assessment techniques for different purposes. For instance, 
those, purposes that don’t relate to, salary often emphasise self-evaluation 
and teacher-administratot cooperative plans. Those that have to dp 
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with merit pay usually involve soma sort of ranking of teachers and use of 
eva luamive boords or cornrait" tess • 

To be effective, evaluation for the improvement of instruction must 
be a continuing .process—not a fitful or sporadic one* It is this fact 
which causes some of the teacher criticism of classroom visitation by ad- 
ministrators, especially if it is done infrequently and without pre- and 
post-conferences. Fawcett (1954) said, "Hasty evaluation of performance 
during performance is not complete, fair or accurate. Taere .should be a 
long sequence of evaluation. 1,17 This requirement is hard to meet because 
of the- many other demands upon administrators’ time, but, unless class 
visitation can be conducted in this manner, it will remain one of the 

poo rex" cvci Iuh Live techniques* < 

On the other hand, this very emphasis upon the need for observation 
over a long period pf time buttresses the case for student evaluation of 
teacher effectiveness. Common arguments against student ratings (as given 
by Kent) are that (a) Students ate not able enough nor mature enough to 
judge effectively; (b) Students have no right to evaluate instructors; (c) 
Rating instruments are subject to bias and unreliability. However, several 
studies have found that students can evaluate fairly and with reliable re- 
suits (e.g., Casey, 1966, Henderson and Chambers, 1951; Kent, 1967). 

Harold Howe , former Commissioner of Education, backed the right of 
students to evaluate instruction when he said, -"The opinion of those who 
eat the pudding certainly ought to be considered if we want to know how it 
tastes .’" 1 ' 9 As one who has for- many years used student evaluation of my own 
teaching effectiveness, I can testify to its worth. We seldom see ourselves 
as our students view us every day- -we normally think we're bftter than we 
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arc, and a periodic, anonymous rating f our scude^^^heOj^rostora par- 
apcctive and, perhaps, some measure /f humility. criticisms and 

suggestions for improvement can be truly helpful topmost of us' if re will 
simply tap this source of instructional improvement ^ 

Certainly, stude^s are at least as .subject to biased judgments as 
are other evaluators. Ue all see the same thing from different vantage 
points and with our perceptions colored by our values and experience-in 
spite of conscious effort to be ••objective". It is important, therefore, 
from both the institutional and the individual standpoint, that evaluation 
of instructional effectiveness derive from mors than one source so that 
various facets and dimensions of the learning-teaching situation may nave 

better change of fair assessment. 

The Highland Community College report, in citing a study by Herge 
<1065), had this intriguing footnote: "In all honesty, . .one must report 

a recent study which indicated that students in classes of teachers ( receiv- 
ing high student effectiveness rating did not necessarily learn morfs than 
those in classes with teachers rated ineffective. Does this suggesfp that 
. students often learn in spite of the quality of instruction they receive?’ 

An example of instructor self -evaluation, reported by Anderson in 
1064, has interesting possibilities for any teacher’s use. In this jexperi- 
ment, each instructor rated himself on a 7-point scale for the following 
attributes: speaking voice; mannerisms or pleonasms; knowledge of subject 
matter; personal enthusiasm; enthusiasm engendered in students; digressions; 
handling of questions; and general atmosphere created in the classroom. The 
instructor then make audio-tapes of two 1-hour class periods. Afte^ li- 
tening to the tapes, he completed anothar rating sheet and compared J^he two 
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ratings , 



Although no statistically 



signifxcant differences were 



found be- 



tween the "before" and "after" ratings, more than half the faculty appeared 
sensitive to the information obtained from the tapes. Of the 19 instructor 
involved, five rated themselves more fqvorably the second time, six rated 
themselves less favorably, and eight did not change their ratings. The 
instructors concluded that the exercise was of value to them. Anderson 



lists the advantages of this technique as follows: 

1, evidencing interest in the teaching process itself by the 
adminsitrati on, 

2, indicating confidence by the administration in the faculty s 
ability to evaluate themselves as professionals and make 
self-indicated improvements , 

3, giving the faculty a workable and frequently interesting 
method whereby they may improve themselves, 

4, preservation of anonymity by faculty * thus forestalling 
feelings of "big brother" watching > 

5, establishing essentially a sel£~operating and perpetuating 
system not calling for a great amount of time, 

6, placing of the dean in the position of being called in for 
aid by a motivated faculty member, rather .ithan being looked 
upon as an intruder with unwanted advice, and 

7, providing specific and concrete examples (preserved on tape) 
of problems which eau be referred to on r^lay, without 
having to rely on no ce a or faulty memory- 

This technique, with additional experimentation (preferably using video- 
tape), could be a valuable tool in producing increasingly better instructors 

Wa have been looking at various facets of evaluation for the improve- 



ment of instruction, during the past several minutes --more minutes, perhaps, 
than you care to count at this point. So let me hasten to a conclusion of 

■ ^ O 

this formal part of the presentation by suggesting to you some "do's" and 

F “f 

"don? t , s n of evaluation,' 
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Don" r 
gingerly if 



be afraid of the idea of evaluation^-cmbrace it (at least 
not with passion) * 



Don't take over someones else's plan--develop your own. 

Don 1 1 turn over _.o a small committee the complete responoibili ty of 
determining your evaluation system. A steering committee to coordinate 
the development of the plan would be good; but work toward general imvolve 
ment of faculty and administration in the planning. 



Don't depend on just one type., of evaluation of ins traction, although 
it is sometimes better to start small and build gradually. Give consider- 
ation to several possibilities: student evaluation, self-evaluation, peer 

evaluation, administrative evaluation. 

Don't force a system of evaluation on the faculty, but seek prior, 
general acceptance. Nothing has less meaning or does more harm tnan 
appraisal practices which are distrusted by those being appraised. 

Don't expect perfection of your plan; settle for a little less. On 
the other hand, don't settle for as much less as the maiden lady I heard 
about one time. She loved a rather shiftless, ne'erdowell sort of fellow. 



He was nice enough, but he could never seem to get and keep any money. So 
the good lady decided she was going to have to take action if was ever 



going to be able to marry him, and she said, "John, if you don't go away, 
get a job, and save $3,000, I'm not going to marry you," He said 0, K. 
tie' d try, and he left town. By the time he'd been gone a couple of months , 
the lady missed him terribly and thought maybe she'd made a mistake, Tnen 
one day she saw him walking down the road and ran out joyfully to greet 
him. She said, "Oh, John, have you saved the $3,000?" lie said, "No, but 
I have $33," She said, "That's close enough." , . . , , .So don't settle 
for too little in your evaluation scheme. 

Now I'd like to open the floor for discussion of any of the points 
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I've raised. 
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